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Abstract 



We study stability of a growth process generated by sequential adsorption of particles on a 
one-dimensional lattice torus, that is, the process formed by the numbers of adsorbed particles 
' at lattice sites, called heights. Here the stability of process, loosely speaking, means that 

. its components grow at approximately the same rate. To assess stability quantitatively, we 

investigate the stochastic process formed by differences of heights. 

The model can be regarded as a variant of a Polya urn scheme with local geometric inter- 
ff^ . action. 
> . 
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■ 1 Introduction 

O 



1.1 The model and results 

Let {1, 2, . . . , A^+l} be a lattice segment with periodic boundary conditions, i.e. a one dimensional 
lattice torus with + 1 points. Assume that N > 2. The growth process is a discrete-time 
Markov chain ^(t) = (^i(t), . . . , ^Ar+i(t)), t G Z+ = {0, 1, 2, ... } with values in Z^"*""^, specified by 
the following transition probabilities: 

gui{t) 

+ 1) = m + h + 1) = vi / i 1 m) 



Ui{t)= Y^^jit), i = l,2,...,N + 1, 

where /3 > and Ui is a certain neighbourhood of site i. 

Definition 1 The quantity Ui{t) is called a potential of site i at time t. 
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We consider the following three possibilities for neighbourhood 
(Al) : Ui = {i}, no interaction; 
(A2) : Ui = + 1}, asymmetric interaction; 
(A3) : Ui = {i — + 1}, symmetric interaction, 

where Un+i = {N + 1,1} due to periodic boundary conditions in case (A2); similarly Ui = 
{N + 1,1,2}, Un+1 = {N,N + 1,1} in case (A3). It should be noted that periodic boundary 
conditions are imposed for technical reasons only to avoid boundary effects. 

The growth process above describes random sequential allocation of particles at the lattice 
sites, where (,k{i) is the number of particles at site k at time t. It is motivated by cooperative 
sequential adsorption (CSA) model widely used in physics and chemistry for representation of 
adsorption processes. CSA is probabilistic in nature and captures the following important feature 
of adsorption processes. A molecule diffusing around a certain material surface (say, a bounded 
region either of continuous space or lattice) might get adsorbed by the surface. The adsorption 
probability depends on a spatial configuration formed by locations of previously adsorbed par- 
ticles; for example, the subsequent particles are more likely to get adsorbed around locations of 
previously adsorbed particles. In the opposite scenario the adsorbed particles can inhibit adsorp- 
tion in their neighbourhoods. For additional details and examples we refer the reader to [21 11^ 
and references therein. 

The model under consideration relates to a version of CSA where the unnormalized adsorption 
probability at a location depends on the number of particles previously adsorbed in its neighbour- 
hood. In the mostly studied in physics adsorption model, namely, random sequential adsorption 
(RSA), the adsorption probability equals at any location with one or more neighbours and 
equals 1 otherwise, i.e. essentially no neighbours are allowed. Asymptotic and statistical studies 
of CSA generalizing RSA (by allowing any number of neighbours) were undertaken in [15^ I19j : 
see also [20], where one proposes a model of point process motivated by this CSA. 

Our model can also be regarded as a one-dimensional lattice variant of CSA described in |14j . 
where the adsorbing probability takes the form of a product of probabilities associated with each 
of the adsorbed nearby particles. Indeed, in our model all neighbours contribute the same factor 
P > to the product, so that only the number of neighbours is relevant. If /3 < 1, then one 
expects that adsorption slows down in a saturated region. 

Another source of motivation has been provided by monomer filling with nearest-neighbour 
cooperative effects, see p. 1289 of [2]. This is a continuous-time model on the lattice with a hard- 
core type constraint: only a single particle can be adsorbed at a site. A site's neighbourhood is 
understood as usual, i.e. as in our case (A3), and the intensity of adsorption at a site depends 
on the number of existing neighbours. As a result, there are three non-zero intensities: Ao,Ai 
and A2, determining the model dynamics in the one-dimensional case. The main difference of our 
model from monomer filling is that we allow any number of particles to be deposited at a site. 

The infinite capacity assumption puts our model also into the usual "balls and bins" framework 
of urn models, see [llj, with an essential difference resulting form additional interaction between 
bins. It is easy to see that in case (Al) the model is a particular variant of the well-known Polya 
urn model (see a detailed discussion in Section [L2|) . 
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Finally, we note that our model in case (Al) is closely related to models of neuron growth in 
biology, in particular to the one considered in [6j representing the early stage of neuron growth. 
In their model probability of adsorption is proportional to the a-th power of the number of 
particles at a node {uf{t) was used there instead of in our paper). The same model with 

polynomial weights and its generalizations have been extensively used in modelling a so-called 
"positive feedback" in economics (e.g., see [HI [10] and references therein). A special limit variant 
of our model in case (A3) (arising as /3 — > 0, see Section II. 2p relates to the models of biological 
neural networks studied in [H [7] . 



1.2 Stability 

Loosely speaking, stability of the growth process means that the "profile" i,i{t), i = 1, . . . , N + 1, 
is "approximately flat", i.e. there are no extraordinary peaks. To describe this property in a 
formal way we introduce a process of differences C(i) = (Ci(t), • • • , C7v(*)) & , t G Z+, where 

Ci{t)=C^{t)-CN+l{t), i=l,...,N 

and also for convenience set (^Ar+i(t) = 0. It is easy to see that {C{t), t £ ^+) is also a Markov 
chain with the following transition probabilities 



F{Ci{t + 1) = at) + 5i^k, i = i,2,...,N\ at)} 



zm) 

and 

nut + 1) = Qit) - 1, i = 1, 2, . . . , iv I c{t)} = ^ ^^^^^^^ , 

where 

N+l 

zm) = 5^/3^ 

k=l 

and 

J 1, if z = /c, 
0, otherwise. 



Definition 2 We say that the growth process is stable if the process of differences is an ergodic 
(positive recurrent) Markov chain. Otherwise the growth process is called unstable. 

The following arguments apply when Ui = {i}, when our model becomes a particular case of 
generalized Polya urn model (see [6l IH]). Let 6.i{t), i = 1, . . . , N + 1, represent the numbers of 
the balls of + 1 different types at time t; the probability to pick a ball of a certain type i 
is proportional to w{(,i{t)), and here ■w{x) = (3^. By Rubin's construction arguments (see [l], 
Section 5) if 

= < lim ^i{t) = oo, sup Cj(t) < CXD for all j ^ i> , i = I, . . . , N + 1, 
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and XlfcLi w{k) ^ < oo, then 

Applying the result to our model with /? > 1, since Q{t) = ^j(t) — ^j\f^i{t), we obtain that either 
(i(t) — > cxD for some z E {1, . . . , A''} (on event Ai), or all Ciit) — — oo (on event Atv+i)- In both 
cases transience of the process of differences follows. Thus, the general result for the urn model 
implies that the growth process is unstable. 

In the opposite situation, i.e. when ~ Rubin's results imply that with 

probability 1 all components of the growth process grow to infinity and this is the case in our 
model with < /3 < 1. We prove a stronger result in the case < /3 < 1, namely, we show that 
the distribution of the process of differences stabilizes, i.e. converges to a stationary distribution. 

If /3 = 1, then, regardless of the type of neighbourhood, with probability 1 a// components of the 
process grow to infinity, but the growth is unstable. Indeed, in this case the process of differences is 
a zero drift spatially homogenous random walk with bounded jumps which asymptotic behaviour 
is well-known (Theorem 8.1, ch. 2, in [l8]). If > 3, then the random walk is transient. If 
N = 2, then the random walk is recurrent, but it is null recurrence (as follows from the subsequent 
arguments), therefore the growth is unstable for A^ = 2 as well. If, just for this instance, we also 
allow A^ = 1 (since the process is well-defined in this case as well), then the process of differences 
is just a one-dimensional simple symmetric random walk, which is non-ergodic. If A^ = 2, then 
null recurrence of the random walk follows from null recurrence of its coordinates, since each of 
them is just a one-dimensional symmetric random walk. Thus in the case /3 = 1 instability is 
implied by the properties of zero-drift random walks, therefore this case is completely eliminated 
from our further considerations. 

Stability of the growth process is rather intuitive in the no-interaction case, i.e. Ui = {i}, if 
< /3 < 1. Indeed, in this case growth slows down at the sites with the maximal potential and 
accelerates at the sites with the minimal potential resulting in the stability effect, in contrast to 
the case /3 > 1 where growth accelerates at the sites with the maximal potential and no stability 
is observed. The picture is not so straightforward for the models with interaction: for instance, 
it turns out that the growth process is unstable for the model with symmetric interaction for any 
value of (3. 

To understand possible sources of instability in the models with interaction it is helpful to 
consider two other growth processes, which can be viewed as "extreme" versions of our growth 
process resulted from letting /? — > and /? ^ oo respectively. 

An easy calculation shows that as /? — > the probability to get adsorbed not at one of the 
minima converges to 0. Therefore, a natural interpretation of the formal case "/3 = 0" is that at 
time t + 1 a particle is allocated equally likely at any site i such that Ui{t) = minfc=i_,,,_7v+i Uk{t)- 
Similarly, "/3 = oo" can be interpreted as the situation when at time t + 1 a particle is allocated 
equally likely at any site i such that Ui{t) = maxfc=i^,..^7v+i 'Ufc(i)- Consider, for instance, the case 
/3 = 0, A^ + 1 = 4, and Ui = {i — l,i,i + 1}. It is easy to see that, depending on the initial 
configuration, with probability 1 one of the two following events occur: the growth is at even 
nodes only, the growth is at odd nodes only. Such limit configurations can be called an attractor 
of the process by analogy with similar phenomena observed in probabilistic models of biological 



4 



neural networks (see \^,~7] for details). If N is arbitrary, then it is also possible to describe all limit 
configurations of the growth processes in both "/3 = 0" and "/3 = oo" cases. The case "/? = oo" 
is trivial regardless of the value of N and the type of interaction. On the other hand, the limit 
behaviour of the growth process corresponding to "/? = 0" is non-trivial in case of an arbitrary 
for both asymmetric and symmetric interaction, despite quite limited randomness of the process 
dynamics. A detailed study of these extreme models is presented in |21j . 

Though our study of stability of the growth process relates also to the study of morphology of 
random interfaces of growing materials generated by ballistic deposition processes (e.g., see |12lll3j 
and references therein), both our setup and the methodology are quite different from the ones 
used in the present paper, therefore we do not investigate this analogy in further details. 

1.3 Results 

Here and further in the paper by transience of the process ({t) = {(i(t), . . . , CN(t)) we understand 
linit^oo \C(t)\ ~^ oo, where | ■ | is the usual Euclidean norm. 

Theorem 1 Suppose Ui = {i}, i = 1, . . . , N + I. 

(1) //0</3<l, then Markov chain (Cit), t G Z^) is ergodic. 

(2) If P > 1, then Markov chain {({t), t S Z+) is transient. 

The assertion of the second part of Theorem [T] is a corollary of the well known results for Polya 
urn scheme, see [SlIIO], and also the discussion in Section [L2l 

Before we formulate the next statement, we need the following definition. 

Definition 3 Consider a planar process C{t) with polar coordinates {r{t),ip{t)), t > 0. We say 
that C is essentially a clockwise spiral, if 

(i) |r(t)| ^ cxD as t ^ oo, and 

(ii) for some large enough time tq such that (/?(ro) = 27rA;o where ko € 7, we have we have 

(p{Tn) = 2TTko + — , for all n = 0,1,2, ... , 

where all ^ 

Tn = \\ii{t > Tn-i : ^p{t) = — for some k G Z}, n = 1, 2, . . . 

are finite. 

Theorem 2 Suppose Ui = {i,i + I}, i = 1, . . . , N + I. 

(1) If N = 2 and < /5 < 1, then Markov chain {C{t), t G Z+) is ergodic. Consequently, 
^i(t) = ^2(0 = S.3{t) for infinitely many t's almost surely. 

(2) If P > 1, then Markov chain (Cit), t G Z+) is transient. Moreover, if also N = 2, then the 
trajectory of {(i{t), (2{t)) is essentially a clockwise spiral, and S,i{t) = S,2it) = Csit) only for 
finitely many t's a.s. 
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It should be noted that when N = 2 there is an interesting comparison between Theorem [2] on 
the one hand, and the Friedman urn on the other hand. There will be infinitely many "ties" 
(^fc(l) = Cfc(2) = '?fc(3) for infinitely many /c's) if /? < 1; in a Friedman urn with p < 1/2 there will 
be infinitely many ties, while the opposite occurs when p > 1/2: see [4J and Section 6 in [8]. 

Theorem 3 Suppose Ui = {i — + 1}, i = 1, . . . , + 1. Then Markov chain {C{t), t G Z+) 
is transient for any N > 3 for any (3 € (0, 1) U (1, oo). Moreover, if [3 > 1, then with probability 

1 there is a k £ {1, . . . , + 1} such that 

lim (,i{t) = oo, if and only i/i € {fc — 1, A;}, and 

1™ 7 TIT = /5 > 

where c = lim(^oo[&+i(i) - ^k-2{t)] G 

To prove the results of the present paper we combine the constructive methods of studying 
asymptotic behaviour of countable Markov chains from [3j with probabilistic techniques used in 
the theory of processes with reinforcement from [22] (in contrast with the purely combinatorial 
methods used in [21j). 

2 Proofs 

2.1 Proof of Theorem [1] 

If Ui = {i}, then process of differences (Ct, t G has the transition probabilities 
and 



p{o(t + 1) = Qit) + vi I cm = J:^ k = i,...,N, 



F{Ci{t+i) = at)-i,i = i,...,N\c{t)} ^ 



Suppose < (3 < 1. Consider the following function 

N 

/(x) = |xp = ^Xi, X = (xi, . . .,Xn) G Z^. 

1=1 

It is easy to see that 

A := E [fiat + 1)) - fiat)) I G = X] = Ef=i(2x.(/3-'^-l) + l+r- 

and for any e > 

A + e = 1^^(2x^(1 -p-^)-l-ie + l)rO 



Now let 

hix) = 2x(l - /?^) - 1 - (e + 1)/?^. 
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It is clear that for x > sufficiently large, h{x) ~ 2x, formally, there is an j4' > such that for 
X > A' we have h{x) > x. Conversely, when x = —a < 0, 

h{x) = h{-a) = -^(2a - e - 1) - 1 - 2a. 

so that h{—a) grows approximately exponentially and again there is an A" > such that h{—a) > 
a when a > A" . Now set 

—C := inf (h(x) — \x\) = mi(h(x) — \x\) 
xe{-A',A') xm 

(note that e + 2 < C < oo). Consequently, 

N N N N 



i=l i=\ 
N 

> -CN 



i=l i=l 1=1 1=1 

N 



i=l 

Therefore, 



A + e< I 'I < 

l + EliP^^ 

except for a possibly finite number of (xi, . . . , xat) lying in the "bad" set 



M := jj^kii < CAf + e| . 



Hence, the conditions of the Foster criterion (Theorem[5]) are satisfied and Markov chain (ClOi ^ ^ 
Z_|_) is ergodic. Thus the first part of Theorem [1] is now proved. ■ 

2.2 Proof of Theorem [2] 

2.2.1 Proof of part (1) of Theorem [2] 

Let TV = 2 and < /3 < 1. Set Ci(t) = Ciit) - Csit) and C2(t) = - Csl*)- The new process 
C(^) = (Ci(0)C2(i)) is a time-homogeneous Markov chain on 1? with the following transitions 

f3X ]^ -\-X'2 

P{C(i) = (xi + l,X2)|C(i) = (xi,X2)}- ^ 











PX2 




pxi+X2 












Pxi+X2 







P{C(t) = (xi,X2 + l)|C(i) = (xi,X2)} 
P{C(t) = (Xi - 1,X2 - l)IC(i) = ixi,X2)} 

It is natural to expect that the Markov chain approximately follows the solutions of the differential 
equation 

dx2 _ ijxi 



dxi /3^i+^2 - p- 



x\ 
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or, after making a substitution u = (3 ^'^ , v = (5 , 

dv ^ vjn-v) 

du m(1 -v) ^ ' 

which we cannot solve analyticahy, but whose solutions seem to be spirals (see Figure [TJ. Hence 
a good candidate for a Lyapunov function for the process, i.e. the function /(x) = g{P~^^ , l3~^^) 
such that E [/(C(i + 1)) — /(C(^)) I C(*) = x] < —const would be a function which level curves have 
a constant angle with the vector field generated by ()2.ip . Then the level curves for g{u,v) will 
satisfy the differential equation 



Figure 1: Trajectories of the dynamical process following the Markov chain. 



3- 




du dv 



{v{v — u),u{l — v)) 



cos a 
sin a 



— SlUQ 

cos a 







for some a, which in turn might depend on initial conditions. Numerical solutions for the level 
curves are presented in Figure [2j Though not being able to solve the above equations analytically, 
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we found an alternative suitable function (j2.2p , whose level curves are in Figure [3l Thus the proof 
of part (1) of Theorem [2] is based on the following lemma. 



Lemma 1 Suppose that (3 <1. Let 
for any x = (xi, X2). Then for any 5 > 

E [ficit + 1)) - fm) I m = x] < -(1 - /3) 

once |x[ = Y^x^~+~x| is larger than some C = C{j3) > 0. 



(2.2) 




Figure 3: Level curves for f{x,y) given in (j2.2p for (3 = 0.9 
Proof of Lemma [TJ We see that 

{l-P)A{u,v) 



E[/(C(t + l))-/(C(t))|C(t)=x] + l-/3 



(3^v'^u^{l + u + uv) 



where 



A{u, v) = {(3^ + p'^)v^u^ + {13^ + f}^)v^u + {13^ + (3^ + [3^ + I3'^)v\^ 
+ + + (3'^)u - {13 + 13"^ + + (3^)]vu^ + v^^^ + /3^n^ 



(2.3) 



-{l + u' + uv + u'v)u'v''(3'' - (1 + /3 + + + /?^)u^'t;« - (/3^ + + /?^)to'' 

and M = /3^i , = (3^^ . The term P^u^v^ clearly dominates all the negative terms, and the term in 
the square brackets is nonnegative for u sufficiently large, hence there is a constant ci such that 
A{u,v) > once min(n, t>) > ci. 
Similarly, 
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which is also nonnegative once mm(u, v) > ci for some C2 > and 

v^A{u, 1/v) = (5^u\^ + ©(-uV) 

is nonnegative when min(ti, v) > C3 for some C3 > 0. 
Finally, 

u\^A{l/u, l/v) = (3^u%^ + /3Vz;^ + + (3^ + (5^)v^ (2.4) 

+ /3^nV(/?i;^ + - v'^u) + 0(n^=^) + 0{u\^) 

Let = Z?""^ + 15~^ + P^'^ + P^^. For u > /■Tti the expression in the second line of (j2.4p is always 
nonnegative; on the other hand for u > K~^v the term is going to dominate in this line, 
hence for n, v larger than the second line of ()2.4p is nonnegative. The third line of (j2.4p is 
nonnegative when u > v. In principle, it can become negative when u < v, however, since x and 
y are integers, it implies that when u < v, also u < /3f , so that + — v'^u > v'^{l5v — n) > 0. 
Thus we have established that A(l/u, l/v) > for all legitimat^ u,v such that min{ti,f} > C4. 
Consequently, we have shown that on the positive quadrant A{u, v) >0 whenever 

{u,v) e [e^\oo) X U (0,e] x (0,e] U {0,e] x [e"\oo) U (e~\oo) x (0,e] 

for some e > (assume without loss of generality that e < 1). 
Next, since 

A{u, v) = {vl3^ + + p\ + + 0{u^) 

as a Taylor series on u and 

A{u, v) = u^P^iP^ + P^ + p + u + l)v^ + 0{v^) 

as a Taylor series on v, we see that there is an ei € (0, e] such that for all v € [e, e~^] and u > e^^ , 
and for all u € [e,e^^] and v > e^^ respectively, we have A{u,v) > 0. 
On the other hand, for small u and v respectively, we have 

A{u, v) = P^v^ + u X Polynom]^(u, v, P) = P^u^ + v x Polynom2(ii, v, P). 

where Po\ynom^{u,v, P), i = 1,2, are some polynomial expressions involving u, v, and p. Hence 
there is an £2 £ (Oi^] such that A{u,v) > whenever < u < £2 and v € [£,£~^] or < u < £2 
and u € [£, £""*"]• 

Combining all the results above, we conclude that the right side of (j2.3p is nonnegative for all 
X E which are outside of the square [—R,R]^ where R = log(min{£i, £2})/ log(/?). Lemma[T]is 
proved. ■ 

Because of Lemma [Hand the fact that /(x) — > 00 whenever |x| 00, we can apply Foster's 
supermartingale criterion (Theorem [5]) . ■ 

^i.e. of the form u = P''^ v = {xi,X2) G 
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Remark 1 We observed that the following function 

Xi + X2 8xi — 3X2 8^1 — 7X2 —xi — 3X2 



/(x) = max 



10 



25 



20 
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(2.5) 



also satisfies Foster's supermartingale criterion (its level curves are congruent to the ones in 
Figure however, the proof of this fact requires going through a large number of special cases 
and hence is omitted in favour of using \2.2^ . 




Figure 4: Level curve for f{x,y) given in ()2.5 



2.3 Proof of part (2) of Theorem [2] 

We start by proving transience for any N > 2. Set r]i(t) = ^i(t) — Ci-i{t), i = 2, . 
= ~ ^N+i{t), because of the periodic boundary conditions. Then 

^2{t) = ^N+i{t) + vi{t) + m{t), 



,N + 1 and 



and obviously Y^^J]^ = 0- We also have 

P{^i(t + 1) = ^i{t) + l\i{t)} oc (3■i\m{.t)+■■■+vm+v^+l{.t) 

for i < N, and, in turn, 

We are going to show that Markov chain 

v{t) = {m{t),V2{t),...,m+i{t)), i e Z+, 
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with state space {x = (xi, . . . , jjat+i) : xi + ■ ■ ■ + xn+i = 0} is transient. It is easy to see that 
transience of {ri{t),t € Z^) implies transience of {C{t),t € Indeed, if ((^{t),t E Z+) were 

recurrent, then ^i(t) = • • • = ^N+i{t) for infinitely many t almost surely. But this would imply 
that r]i{t) = ••• = r7jv_|_i(t) = for infinitely many t almost surely as well, thus contradicting 
its transience. In other words, coordinates of ?7-process are consecutive differences of coordinates 
of the growth process, therefore transience of r]{t) yields transience of the process of differences, 
because the probability distribution of the later does not depend on the subtracted coordinates 
(due to the symmetry and periodic boundary conditions). 

To prove transience of {r]{t),t S Z+) we are going to apply Theorem [H To this end, consider 



the function 



/(x) 



X2 



1 



, max{|xi|, \x2\ 



if xi 

otherwise. 



XN+l = 



defined for any x = (xi, . . . ,xn+i)- We now will show that, provided that |x| is large enough, 
IE [fivii + 1)) - fiv{t)) I Vit) = x] < 0, establishing the result. 
Indeed, consider the four following possibilities. 

(al) > 3 and the maximum L of xi,X2, ■ ■ ■ ,a;Ar+i is not unique and there are at least two 
indices i,j such that \xi\ = \xj\ = L and they are at least distance 2 apart, i.e., |i — j| > 2 
(understood with periodic boundary conditions). 

(a2) N = 2 and \xi \ = \x2\ = \x2,\ = L. 

(b) The maximum L is not unique and there are exactly two maximums next to each other. 

(c) The maximum L is unique. 

Observe that in cases (al) and (a2) no step of the chain rj can decrease the maximum, hence 
E [f{r]{t + 1)) - /(r/(t)) I ri{t) = x] < here. 

In case (b) suppose without loss of generality that the maximum is achieved at nodes 2 and 
3, so \x2\ = Ixsl = L. Then E[/(r/(t + 1)) — f{r]{t)) \ r]{t) = x] is proportional (up to a positive 
coefficient) to 

1 r 



p2xi+X2 
_|_ ^2a;i+2a;2+X3 

+ 0- 



max{|xi + 1|, jx2 — 1|, L} L 

1 1 
L 



max{|x2 + 1|, |x3 - 1|} 

2xi+2a;2+2a::3+a;4 



1 



1 



max{L, |x3 + 1|, — 1|} L 

{if N = 2 then we set X4 = xi). We can see that unless X3 = L = — X2 the quantity above is always 
negative. However, when X3 = L = — X2 we also have that the quantity above is proportional to 





1 


1' 


+ 


1 1' 


_|_ pX3+X4, 


1 


1" 




L + 1 


~ L 


L-1 L 


L+1 


~ I 



L(L2 - 1) 



L(L2 - 1) 



X3 + X4^> 1) 
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which is negative once L > 3. 

Finahy, in case (c) suppose that the maximum is achieved at node 2, \x2\ = L. Then E [f{r]{t + 
1)) — f{7]{t)) I r]{t) = x] is proportional to 



(*) := 
When X2 = L, 



1 



1 



maxjlxi + 1|, |x2 — 1|} L 



1 



1 



max{|x2 + 1|, - 1|} L 



(*) 



< 



1 1 

max{|xi + 1|, L — 1} L 

" <0 



+ !}■ 



•X2+X3 



L + l L 



L(L-l) L{L + l) 



once L > + l)/(/3 - 1). 

And in the last subcase X2 = —L 



(*) 



1 



1 



< 



L + l L 
1 



L{L + l) ' L(L-l) 



1 



1 



+ 



max{L — 1, |x3 — 1|} L 
< 



again once L >(/?+!)/(/? — 1). 

Consequently, E [f{'r]{t + 1)) | r]{t) = x] < /(x) whenever |x| is sufficiently large, and by 
Theorem m Markov chain {r]{t), t G is transient. So the transience is proved for any N >2. 

Prom now on assume that N = 2. First, let us prove that the process C{t) = {(i{t),(2{t)) 
cannot remain indefinitely in either of the following 6 areas: x>y>0, y>x>0, x>0>?/, 
y>0>x,0>y>x, and > x > y. 

Indeed, suppose that for some time Iq we have C(^o) ^ ^1 ■= {(x,y) G : x > y > 0}. 
When ((t) G ^-i, it is clear that (2(0 has the property E [C2(t + 1) | C{t) = (x,y)] < (2{t). Hence 
M{t) = (2{t A r), t > to, where 

r := inf{t > to : Ci{t) = C2(t) or C2(t) = 0} = inf{t > to : ((t) i ^-i} 

is a non-negative supermartingale which converges a.s. Since M(t + 1) — M(t) takes only integer 
values, it means that for some (random) T, M(t) = const for all t >T. However, this is impossible 
unless T < 00, since for a fixed y > the probability 

1 1 



P(M(t + 1) = M(t) - 1 I C(t) = (x, y) G 



> 



does not go to zero, thus implying by the conditional Borel-Cantelli lemma (see e.g. Corollary 2 
on p. 518 in [17j) that for some large t > T we have M(t) 7^ M{t + 1). Therefore r is finite. 
When C(to) e ^2 := {(x,y) G : y > x > 0}, set M(t) = C2(t" At) - Ci(r A t) and 

r := inf{t > to : Ci(t) = Ut) or Ci(t) = 0}. 

Again M(t) is a non-negative supermartingale which cannot converge unless r < 00, since on 
{r = 00} the event |M(t + 1) - M(t)| < 1 implies M(t + 1) = M{k) and thus Ci{t + l) = Ci{t)-l. 
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The remaining 4 cases will analyzed briefly, since the argument is very similar. When x > > y 
or y > > X, the probability to go towards the axis x = is larger than away from it, hence 
eventually C{t) will leave either of these areas. When > y > x there is a drift upwards, and 
finally when > x > y there is a drift towards the line x = y < so that a non-negative 
supermartingale Ci(^) ~Ci(^) must converge, and at the same time cannot remain indefinitely 
on the line (—a, —a — A), where A > is a constant and a = i,i + l,i + 2, . . . , since along this 
line there is a non-diminishing probability to go up, of order 

Finally, we need to show that the process C,{t) eventually "rotates" in one direction on its 
way to infinity. This immediately follows from the following Lemma [21 taking into account the 
established transience, the Borel-Cantelli lemma and the summability in a of the terms on the 



Lemma 2 Assume /? > 1. Suppose a,k > I and let E/. be the event {the trajectory of C,{t) for 
t > k crosses {{0,y),y < 0}, {{x,0),x < 0}, {(0, > 0}, {{x,0),x > 0} exactly in this order 
and ends up at point (a' , 0) with a' > a + 1}. Then, for some v = > and all large a > 
we have 



Also, similar statements hold for starting points (0, — a), (— a,0) and (0, a). 

Proof. (1) Let us show that when the process leaves (a, 0), it ends up at (0,-6), b > a, with 
probability very close to 1. This will be done by demonstrating that initially the process moves 
only right and left-down (south-west, SW for short), and then after reaching level y = —a/2 (for 
simplicity assume that a is even), it moves only in the SW direction, all with high probability. 
Indeed, suppose that Ci'^o) = («> 0) for some tq. For i = 1,2, . . . define 

Ti = inf{t : C2(t) = -i}, 

Ai = {3k e {1,... ,a} : C2{Ti^i + k) = -i, but (2(^-1 + m) = -i + 1 Vrn € {0, . . . , A; - 1}} , 

where the latter is the event that after reaching level y = —{i — 1), the process C(t) makes less 
than a consecutive steps to the right, after which it moves in the SW direction. 
On the event Ai the stopping time Tj is finite, also on n*-^^j4j we have 

C(Tj) £ G := {{x, y) G : y < and y < x — a < —ay}. 

Then for 1 < i < a/2 - 1 



RHS of ([2:6]) . 



P(E^|C(^) = (a,0)) <exp(-i/a). 



(2.6) 




(2.7) 



since the probability to jump to the right from {x,—i) is 



— < p-\ 

>X — l ^ 
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and the conditional probability to jump up from {x, —i), given that the next jump is not right- 
wards, is 



(5-^ + P- 

(recall that C(^j) ^ G). Taking into account that 



n^i)>(i-^) (i-r'^) 



from (12.71) we conclude 




> 1 - ae-""" (2i 



where 



z/ = min {log /?, log 2} > 0. 



Once the process C{t) has reached level y = —a/2 such that all Ai, i = 1, 2, . . . , a/2, occurred, 
we know that Ci'^a/2) = (^*) ""^Z^) and a/2 < x* < a+a^/2. However, from (x, —i) the probability 
not to go SW is 

^ ^' : < [5-' 

(as X > i) therefore with probability at least 

(l - - ~ Z^"''^^)"^" > 1 - (a + aV2)/3""/^ > 1 - a^e-^"/^ (2.9) 

the process will make only SW steps until it reaches the vertical axes at some point (0,-6) with 
b>a. 

The argument for the remaining 5 cases is very similar, hence we just sketch the proof. 

(2) Suppose the process starts at (0, —a), a » 1. We will show that with probability close to 
1 it ends up on the line x = y at the point (—6, —b) with b > a + 1. 

Consider the trajectory of the process along the lines — where j is called a level, 

with the probabilities to jump up, right, and SW being proportional to , P~^~^ , 1, respectively. 
Also, initially i = 0, j = a. With probability 

(1 - 2/?-'^)" > 1 - 2ap-'' 

the process starts with consecutive a SW steps. After this, a conditional probability that the 
jump was "right" but not "up", given that one of the two has indeed occurred, is at most P~'^. 
Hence, with probability 

(1 - p-")" > 1 - ap-" 

the process will consecutively pass through the levels j — 1, j — 2, . . . , until it reaches the line 
X = y < 0. Is is also clear that the process cannot remain indefinitely on the same level j, as 
there is a constant probability to go up, of order P~^ . Consequently, the process will arrive to 
(—6, —b) where b > 2a (in fact, we expect b to be of order ! + /? + ••• + 
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(3) Next, suppose the process starts at (—a, —a), a ^ 1. We will show that with probability 
close to 1 it ends up on the line y = at the point (—6, 0) with b > a. 

Again, notice that after approximately geometrically (1/2) distributed number of SW steps 
along the line x = y, the process jumps up and the relative probability to jump "up" vs. "SW" is 
around /?/(/? + 1) > 1/2. As before, we can show that the process will reach the horizontal axis 
in a number of steps of order a never ever making a "right" step with probability of exactly the 
same order as in (1). 

(4) Suppose the process starts at {—a, 0), a ^ 1. By very similar arguments we can show that 
the process will reach the point (0, b) with b > a never making a SW move on its way, thus going 
through level lines x = —j, k = a,a — 1, . . . ,0, with probability close to 1. It should take around 
1 + /3 H h steps. 

(5) Suppose the process starts at (0,a), a » 1. Again, by similar arguments one can show 
that the process will reach the point (b, b) with b > a never making a SW move on its way, with 
probability close to 1. 

(6) Finally, suppose the process starts at (a, a), a » 1. One can easily show that the process 
will reach the point (b, 0) with b > a never making an "up" move on its way, with probability 
close to 1. 

To finish the proof, fix some v G (0,t'/2). Combining (12. Sp and (12. 9p with similar results 
established in (2) through (6), we conclude that the probability that C,{t) started at (a,0) will 
sequentially visit the areas {x > 0, y < 0}, {x < 0, y < 0}, {x < 0, y > 0}, {x > 0, y > 0}, and 
end up at a point (a', 0) with a' > a + 1 is at least 

1 - e"'^" 

for all a larger than some constant A = A{v,(3). ■ 

2.4 Proof of Theorem [3] 

2.4.1 Proof of Theorem [3] for /5 > 1 

Recall that in the symmetric case 

n^^{t + 1) = m + kk, i m = « , a; = i, . . . , iv + 1. 

Therefore, for k = 1, . . . , 

nut + 1) = at) + <5,,fc, vi I at) = x} cx (2.10) 
nck{t + 1) = ut) - 1, = 1, . . . , AT I c{t) = x} cx ^1+-^, 

where xat+i = in (j2.10p by convention. Let 

Uk{t) = ik-i{t) + ikit) + ik+i{t). = 1, . . . , AT + 1, 

and recall that Uk{t) is a potential of site k at time t. The process u{t) = {ui{t), . . . ,U]\f^i{t)) is 
a Markov chain with the transition probabilities given by 

P(Efc(t)KO) = ^^^^r^' k = l,2,...,N+l 
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where 

Ekit) = {ui,{t + 1) = ui{t) + 1, i = k-l,k,k + l, 

and Ui{t + 1) = Ui{t) \fi ^ {k - l,k,k + 1}}, 

that is, at time t + 1 a particle is adsorbed at node k. 

Fix some small e > 0. First, we will show that there is a = (5(/3, N, e) such that if for some 
time T we have Uk (T) = maxj Ui (T) , then 

oo 

P I ^t) > 5, where S^^''^) = f| [Ek-i{t) U U Ek+i{t)] 

t=T 

and is the sigma-algebra generated by the process u{t) up to time T. Secondly, using the 
conditional Borel-Cantelli lemma, we will establish that, in fact, with probability 1 there will be a 
k € {1, 2, . . . , + 1} for which the event B^'^"^ occurs. Finally, we will show that B^'^^ implies, 
with probability one, that either flt^T [Ek-i{t) U Ek{t)] or Ht^T [Ek{t) U Ek+i{t)\ occurs. 

Initially, suppose that + 1 > 5. Without the loss of generality, assume that A; = 3, i.e., 
U'i{T) = maxj Ui{T). Since the process u is time- homogeneous, we can also set T = 0. Denote 



E2{t + 1) U E3{t + 1) U Ei{t + 1), 





E2{s) + li?4(s)] ^ 

= {nodes 2 and 4 together adsorb less than (2/3 + e) t 
particles during the fist t trials}, 

where 1^ is the indicator function of event E. In these notations 

F{Bt+i) > F{At+i I BtCt)F{Ct \ Bt)F{Bt). (2.11) 

Note that u^^t) = u^^O) + 1 on event B^. Also 

max{ui (t ) , U5 (t ) } < U3 (0) + (2/3 + e)t 

on event BtCt- Consequently, we can bound the first conditional probability in the right side of 
(plT]) as follows 



F{At+i I BtCt) = 1 + 



> • (2-12) 

1 + 2/3-V3-=j* + (Af - 4)/?-* 

Also, on event Bt for s < t we have U2{s) < U3{s) and U4{s) < ^3(5), hence the probability to get 
adsorbed at nodes 2 or 4 is smaller than or equal to 2/3, hence, using large deviation estimate for 
the sum of Bernoulli(j5) random variables from [17], Section IV. 5, with p = 2/3, we obtain 

F{Ct\Bt) >l-2e-'^^^\ (2.13) 
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Combining bounds (j2.12p and (j2.13p we conclude that 



nBt+i) > {i-7t)nBt), 

where 74 is summable. Thus event i?oo = f^t^iBt occurs with probabihty at least 

00 

5 = P(5i) ]J(1 - 7t) > 0. 

£=1 

Let k*{T) = mm{i G {1, 2, . . . , iV + 1} : Ui{T) = maxuj{T)}. Since P (-B[TJ^^ ^) | J^t) > S, by 
the second conditional Borel-Cantelli lemma, eventually one of these events will occur. 

However, on event b!^'^^ it is easy to see that there will be infinitely many arrivals to the 
set of nodes {A; — + 1} (as it is impossible a.s. that only node k adsorbs all the particles). 
Hence, if we consider the times when a particle is adsorbed at either node /c — 1 or node k + 1, 
then (ufc_i,nfc+i) has the same distribution as the balls in a two-colour urn with exponential 
reinforcement w{x) = (3^ (see Section [1.2p ; hence by Rubin's theorem we eventually stop picking 
one of the two nodes. 

Finally, suppose that nt^T(-^fc-i(*) ^ -^fc(^)) occurred. On this event, for each t > T, the 
probability to get adsorbed at k, divided by the probability of that of A; — 1, is constant and equals 
P'^ where c = Uk{T) — Uk-i{T) = (^k+i{T) — ^k-2{T), from which the statement of the Theorem 
follows by the strong law of large numbers applied to a sequence of i.i.d. Bernoulli(/3^/(l + jS^)) 
random variables and the finiteness of Uk~i{T) and nfc+i(T). 



To finish the proof, we need to consider the special cases: + 1 = 4. In this case the proof 
is virtually identical to the case + 1 > 5, except that we get slightly different expression in the 
RHS of dm]), given by 1/ [l + /?-(V3-£)t] . B 

Remark 2 It is relatively easy to prove just transience of the process of differences. Namely, 
consider a stochastic process formed by differences of potentials 

Vk{t) = Uk{t) - UN+iit), k = l,...,N. 

It is easy to check that process {v{t), t £ Z^) is a Markov chain and that transience of {v(t), t G 
Z-|_) yields transience of (Cit), t € In turn transience of process {v{t), t G Z_|_) can be 

established by applying Theorem with set 

M = Ca = {y£Z^:yi>a,y2-yk>a,k = A,...,N} 

and Lyapunov function 

N 

f{y) = p-yr+Y^p-y2+y.^ 

k=4: 

if N > 4:, and set M = T>a = {x € : y2 > a} ctnd Lyapunov function /(y) = if N = 3, 

where in both cases a > 1 can be any integer. 
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2.4.2 Proof of Theorem [3] for < /3 < 1 

Assume now that < /5 < 1. First, assume that + 1 = 2M is even. If the process C, were 
recurrent, there would be infinitely many times t when ii{t) = (,2{t) = ■ ■ ■ = £,N+i{t)- However, we 
will show that given such a configuration occurs at time T, with a positive probability, independent 
of T, the following event 

A:={ lim Ci{t)/t = l/M for even i and supCi(t) = ^i{T) for odd i} 

occurs. This immediately implies transience of C- 

Intuitively, the reason why A occurs with a positive probability, is the following. Without 
loss of generality assume T = and ^i(T) = for all i. Then as long as ^i{t) remain for odd 
i's for all t, the process on even z's is a Polya urn scheme, with negative reinforcement, hence we 
must have that the relative heights of the "peaks" converge to one (see the proof of Theorem [1]). 
Therefore, for large times t > to we have £,i{t) ~ t/M for even z's. On this event, the probability 
never to add anything into odd i is asymptotically bounded below by 



n 

t=to 



oo r ^ 
1 



n 

t=to 



1 + 



> 



and hence is "compatible" with our initial assumption that ^j's remain unchanged for all odd i's. 

To make the argument above rigorous, we borrow the idea from the proof of the main theorem 
in [22]. Namely, consider the process ^{t) at the stopping times Tk when the maximum value of 

reaches k'^, that is 



Tk = min{t > : max ^2j{t) = k"^}, k = 1,2, . . . 
j=l,...,M 



Let event Ak he 



Ak = \ min ^2j{Tk) >k^-k and = 0, j = I, . . . ,m\ 

|^j=l,...,M J 

We will show 

¥{Ak+i\Ak,Ak-i,...) > 1 - 7fc 
with ^ 7fc < oo and hence nfclA;o(-'^ ~ 7^) > ^- Since A ^ flfclfco yields 

(oo \ oo 

fl = nAk,) n HAk+1 1 Ak,Ak-i, Ak,) 
k=ko I k=ko 



oo 



k=ko 

To establish this, first of all, observe that given Ak the conditional probability that none of odd 
increases between times Tk and Tk+i, is bounded below by 
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since 

Tk+i -Tk< Tk+i < 2M{k + if < 8Mk^. 

for k > 1. 

From now on let us assume that we are on the event where all ^2j-i's remain during the 
time interval [Tk,Ti^+i)', this effectively restricts all adsorptions to take place at even nodes and 
thus the transition probabilities are well-defined. Let 

K = k(s) := minjt > s : max foiit) = 1 + max foiC-s)} 

j=l,...,M j=l,-,M 

be the time when the maximum increases for the first time after time s. 
Lemma 3 There is an e > independent of anything but M , such that 

P {all £,2j{K — 1) are the same \ J^s) > £, 

where k = k{s). 

Loosely speaking, this states that with probability at least e all ^2j's will "catch up" with 
the largest of them before this largest one increases even by 1, independently of the past and the 
actual values of ^2/3. 

Proof of Lemma [3l Fix a large a > such that < and first assume that for some 

t G [s, k) 

max ?2i(*) - . min £2i(i) = I > a. 

j=l,...,M j=l,...,M 

Then, since there are at most M — 1 maxima, the probability that each of the minima (and there 
are at most M — 1 of them) increases by 1 before any of the maxima increases, is at least 

1 - (M - l)f3^ 

However, when all the minima increase, it results in I I — 1. Consequently, since 1 — > 0, 

the probability that all of increase until they fall within the a-distance of the maximum before 
the maximum even changes by one is bounded below by 

00 

e' = Jl (1 - m2/3') > 0. 

l=a 

But once max-,- ^2jit) — minj ^,2j{t) < a, the probability that all ^2j's will catch up the maximum 
value before k is at least 

e" = M-"(*^-i) > 0. 

Hence the statement of the Lemma follows with e := e' x e" . ■ 

Now pick an e > satisfying the condition of Lemma [3] and let 

f(y) = min{t : max > y}. 

j=l,...,M 



> 1 - M^/?'. 
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Observe that process C2j{t), j = 1,2, . . . , M at the times f(fc^ + k + x) ior x = 1,2, ... ,k. By 
Lemma [Sj for each of those stopping times with probabihty at least e, independently of the 
past, all ^2j's become equal before the time Tk+i is reached. Hence, the probability that at least 
one of these events (all are equal) occurs is at least 

l-(l-^)' = l-7^ 

However, the event {for some t < t^+i we have ^2j{t) = k'^ + k+x for all j} yields miuj ^2j(Tfc+i) > 
/c^ + A: = (A; + 1)^ — (A; + 1), thus implying the event Ak+i- 

Consequently, we have shown that P(Afc+i I ^kj^k-i, • • • ) > 1 — 7fc where 7^ = 7^ + 7^,' is 
obviously summable, and this proves the required transience for the case when + 1 is even. 



The case of odd + 1 = 2M + 1 is analyzed similarly, though obviously we cannot produce 
a transient configuration with alternating peaks and zeros. Instead, redefine the event A as 

A := I lim lli^ = Hm 1^0. = lim ^1^^ _ — £qj. gyen i > 4 

[t-^OO t t^oo t 2M t^oo t M ~ 

and sup^i(t) = ^i(T) for odd i > 3 > , 
t>T J 

the positive probability of which will imply transience of process C- 
Set 



6,(t), ifj = 2,...,M, 



Tj. = min{t > rfc_i : max £,2j{t) = k'^}, k = 1,2,.... 

j=l,...,M 

Let now the events Aj^. be 

Ak = { min e2i(Tfc) >k^-k, |6(Tfc) - 6(Tfc)[ < 

Ij=1,...,M 

and6j+i(T-fc) = 0, j = l,...,M}. 

As before, we want to show F{Ak+i \ Ak,Ak-i, • • • ) > 1 — 7fc with ^ 7^ < oo. 

Firstly, the lower estimate of the conditional probability (given A^) that none of the 6's for 
odd i > 3 increases before t^+i is now replaced by 

for k > max(M, 135). 

Secondly, conditioned on the above event, the probability that 

min C2j{Tk+i)>{k + lf-{k + l) 
j=l,...,M 

is bounded below by the same quantity 1 — 7^' as in the case when A^ is even (the proof is a 
verbatim copy of that case). 
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Finally, which is new here, we need to ensure that 

Mrk+i) - Urk+i)\ <{k + l)'-^ = k'-' + IM'-' + o(l). 

Now, the conditional probability that or ^2 resp. increases, given that either of them increases, 
is the same and equals 1/2. On the other hand, the number of those times t € [rfc,r/;+i] when 
(,i(t) + ^2(i) indeed increases, lies between k and 3k + 1, hence by the law of large deviations used 
as in [22], we have 

n\mrk+i) - - {6(Tfc) - 6(Tfc)}| > k^-^) 

<exp(-2fc0-2 + o(l)) =:7- 

Consequently, 

F{Ak+i\Ak,Ak-i,...) > 1 - 7fc 
with 7fc = 7fc + 7fc + 7fc' and the same conclusion (i.e. transience) holds. ■ 

3 Criteria 

The following constructive martingale criteria for ergodicity and transience were used in our paper; 
their proof can be found in [3]. Let (k^, k > 0) he an irreducible aperiodic Markov chain on a 
countable set A. 

Theorem 4 ([3], Theorem 2.2.2) The Markov chain is transient if and only if there exist 
a set M C A and a positive function f{r]i^) such that 

E [/(%+i) - /(%) \rik = v]<Q for all v ^ M; 
f{vi) < inf f{v), at least for one vi ^ M. 

Theorem 5 ([3j, Theorem 2.2.3) The Markov chain rj^ is ergodic if and only if there exist a 
finite set M , an e > 0, and a positive function f{rik) such that 

E [/(%+i) - /(%) \rik = v]<-e for all v ^ M; 

E [/(??fe+i) \T]k=v]<oo for all v. 
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